Papers with homogeneity score
Getting BART to Ride the Idiomatic Train: Learning to Represent Idiomatic Expressions (2022.tacl-1)
Copied to clipboard
| Challenge: | Prior work has identified deficiencies in their contextualized representation stemming from the underlying compositional paradigm of representation. |
| Approach: | They propose to use an adapter as a lightweight non-compositional language expert trained on idiomatic sentences to build idiomity into BART. |
| Outcome: | The proposed approach improves idiomaticity over baselines and up to 25% higher sequence accuracy on idiom processing tasks. |
Unified Representation for Non-compositional and Compositional Expressions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing representations of non-compositional language are based on BART, but they are not as accurate as the state-of-the-art IE representation model, GIEA. |
| Approach: | They propose a language model, PIER+, that builds on BART and can generate semantically meaningful and contextually appropriate representations for English potentially idiomatic expressions. |
| Outcome: | The proposed model achieves 33% higher homogeneity score on embedding clustering than BART, while sacrificing performance on NLU tasks (+/- 1% accuracy) |